Light Field compression and manipulation via residual convolutional neural network

Light field (LF) imaging has gained significant attention due to its recent success in microscopy, 3-dimensional (3D) displaying and rendering, augmented and virtual reality usage. Postprocessing of LF enables us to extract more information from a scene compared to traditional cameras. However, the use of LF is still a research novelty because of the current limitations in capturing high-resolution LF in all of its four dimensions. While researchers are actively improving methods of capturing high-resolution LF\u27s, using simulation, it is possible to explore a high-quality captured LF\u27s properties. The immediate concerns following the LF capture are its storage and processing time. A rich LF occupies a large chunk of memory ---order of multiple gigabytes per LF---. Also, most feature extraction techniques associated with LF postprocessing involve multi-dimensional integration that requires access to the whole LF and is usually time-consuming. Recent advancements in computer processing units made it possible to simulate realistic images using physical-based rendering software. In this work, at first, a transformation function is proposed for building a camera array (CA) to capture the same portion of LF from a scene that a standard plenoptic camera (SPC) can acquire. Using this transformation, LF simulation with similar properties as a plenoptic camera will become trivial in any rendering software. Artificial intelligence (AI) and machine learning (ML) algorithms ---when deployed on the new generation of GPUs--- are faster than ever. It is possible to generate and train large networks with millions of trainable parameters to learn very complex features. Here, residual convolutional neural network (RCNN) structures are employed to build complex networks for compression and feature extraction from an LF. By combining state-of-the-art image compression and RCNN, I have created a compression pipeline. The proposed pipeline\u27s bit per pixel (bpp) ratio is 0.0047 on average. I show that with a 1% compression time cost and 18x speedup for decompression, our methods reconstructed LFs have better structural similarity index metric (SSIM) and comparable peak signal-to-noise ratio (PSNR) compared to the state-of-the-art video compression techniques used to compress LFs. In the end, using RCNN, I created a network called RefNet, for extracting a group of 16 refocused images from a raw LF. The training parameters of the 16 LFs are set to (\alpha=0.125, 0.250, 0.375, ..., 2.0) for training. I show that RefNet is 134x faster than the state-of-the-art refocusing technique. The RefNet is also superior in color prediction compared to the state-of-the-art ---Fourier slice and shift-and-sum--- methods

Light Field Compression by Residual CNN Assisted JPEG

Light field (LF) imaging has gained significant attention due to its recent success in 3-dimensional (3D) displaying and rendering as well as augmented and virtual reality usage. Nonetheless, because of the two extra dimensions, LFs are much larger than conventional images. We develop a JPEG-assisted learning-based technique to reconstruct an LF from a JPEG bitstream with a bit per pixel ratio of 0.0047 on average. For compression, we keep the LF's center view and use JPEG compression with 50% quality. Our reconstruction pipeline consists of a small JPEG enhancement network (JPEG-Hance), a depth estimation network (Depth-Net), followed by view synthesizing by warping the enhanced center view. Our pipeline is significantly faster than using video compression on pseudo-sequences extracted from an LF, both in compression and decompression, while maintaining effective performance. We show that with a 1% compression time cost and 18x speedup for decompression, our methods reconstructed LFs have better structural similarity index metric (SSIM) and comparable peak signal-to-noise ratio (PSNR) compared to the state-of-the-art video compression techniques used to compress LFs

The immunomodulatory effect 1,25 (OH)2 D3 on TLR 2 and TLR4 expression on monocytes of patients with type II diabetes mellitus

Background: Recent studies have shown the immunomodulatory effect of vitamin D3 through down-regulation of Toll-like receptor (TLR) expression in human monocytes. In this study, the effects of vitamin D treatment on TLR2 and TLR4 expression on monocytes derived from type 2 diabetes was investigated.Materials and Methods: To assess the influence of vitamin D3 on expression of TLR2 and TLR4 on monocytes from patients with type II diabetes, peripheral blood sample was taken of 30 patients. Peripheral blood mononuclear cells (PBMCs) were isolated by density gradient centrifuge and then monocytes were isolated from these cells with using the magnetic activated cell sorting (MACS). To investigate the effect of vitamin D3 on the expression of TLR2 and TLR4, monocytes were cultured in the presence of vitamin D3 (10-9 M) for 48 hours. Then the expression of TLR2 and TLR4 was determined by Real-time PCR.Results: We found that vitamin D3 suppresses the mRNA expression of TLR2 and TLR4 in patients with type II diabetes. TLR2 and TLR4 expression in the patients exposed to vitamin D3 were significantly decreased in comparison with patients who were not treated with vitamin D3.Conclusion: It can be concluded that vitamin D3 supplements may be further analyzed as a therapeutic option by reducing TLR2 and TLR4 expression in patients with type II diabetes

Simulation of light fields captured by a plenoptic camera using an equivalent camera array

© 2018 SPIE. Post-processing of light fields enables us to extract more information from a scene compared to traditional camera. Plenoptic cameras and camera arrays are two common methods for light-field capture. In fact, it has been long recognized that the two devices are in some ways equivalent. Practically though, light field capture via camera arrays results in poor angular sampling. Similarly, the plenoptic camera often suffers from relatively poor spatial sampling. In simulation, we can easily explore both constraints by simulating two-dimensional view point images and combining them into a four dimensional light field. In this work, we present a formalism for converting between equivalent plenoptic configurations and camera arrays. We use this approach to simulate a simple scene and explore the trade-offs in angular and spatial sampling in light-field capture

Modeling standard plenoptic camera by an equivalent camera array

Postprocessing of light fields enables us to extract more information from a scene compared to traditional cameras. Plenoptic cameras and camera arrays are two common methods for light field capture. It has been long recognized that the two devices are in some ways equivalent. Practically, both techniques have important constraints. Camera arrays are unable to provide high angular sampling, and the plenoptic camera can have a limited spatial sampling. In simulation, we can easily explore both constraints by simulating two-dimensional viewpoint images and combining them into a four-dimensional light field. We present a transformation for converting between equivalent plenoptic configurations and camera arrays when they capture pristine light fields produced in simulation. We use this approach to simulate light fields of simple scenes and validate our transformation by comparing the focus distance of a standard plenoptic camera and the equivalent camera array\u27s light field. We also show how some simple practical effects can be added to the pristine, synthetic light field via postprocessing and their effect on refocusing distance

An experimental system for detection and localization of hemorrhage using ultra-wideband microwaves with deep learning

Stroke is a leading cause of mortality and disability. Emergent diagnosis and intervention are critical, and predicated upon initial brain imaging; however, existing clinical imaging modalities are generally costly, immobile, and demand highly specialized operation and interpretation. Low-energy microwaves have been explored as low-cost, small form factor, fast, and safe probes of tissue dielectric properties, with both imaging and diagnostic potential. Nevertheless, challenges inherent to microwave reconstruction have impeded progress, hence microwave imaging (MWI) remains an elusive scientific aim. Herein, we introduce a dedicated experimental framework comprising a robotic navigation system to translate blood-mimicking phantoms within an anatomically realistic human head model. An 8-element ultra-wideband (UWB) array of modified antipodal Vivaldi antennas was developed and driven by a two-port vector network analyzer spanning 0.6-9.0 GHz at an operating power of 1 mw. Complex scattering parameters were measured, and dielectric signatures of hemorrhage were learned using a dedicated deep neural network for prediction of hemorrhage classes and localization. An overall sensitivity and specificity for detection >0.99 was observed, with Rayliegh mean localization error of 1.65 mm. The study establishes the feasibility of a robust experimental model and deep learning solution for UWB microwave stroke detection

Notes for genera – Ascomycota

Knowledge of the relationships and thus the classification of fungi, has developed rapidly with increasingly widespread use of molecular techniques, over the past 10--15 years, and continues to accelerate. Several genera have been found to be polyphyletic, and their generic concepts have subsequently been emended. New names have thus been introduced for species which are phylogenetically distinct from the type species of particular genera. The ending of the separate naming of morphs of the same species in 2011, has also caused changes in fungal generic names. In order to facilitate access to all important changes, it was desirable to compile these in a single document. The present article provides a list of generic names of Ascomycota (approximately 6500 accepted names published to the end of 2016), including those which are lichen-forming. Notes and summaries of the changes since the last edition of `Ainsworth Bisby's Dictionary of the Fungi' in 2008 are provided. The notes include the number of accepted species, classification, type species (with location of the type material), culture availability, life-styles, distribution, and selected publications that have appeared since 2008. This work is intended to provide the foundation for updating the ascomycete component of the ``Without prejudice list of generic names of Fungi'' published in 2013, which will be developed into a list of protected generic names. This will be subjected to the XIXth International Botanical Congress in Shenzhen in July 2017 agreeing to a modification in the rules relating to protected lists, and scrutiny by procedures determined by the Nomenclature Committee for Fungi (NCF). The previously invalidly published generic names Barriopsis, Collophora (as Collophorina), Cryomyces, Dematiopleospora, Heterospora (as Heterosporicola), Lithophila, Palmomyces (as Palmaria) and Saxomyces are validated, as are two previously invalid family names, Bartaliniaceae and Wiesneriomycetaceae. Four species of Lalaria, which were invalidly published are transferred to Taphrina and validated as new combinations. Catenomycopsis Tibell Constant. is reduced under Chaenothecopsis Vain., while Dichomera Cooke is reduced under Botryosphaeria Ces. De Not. (Art. 59)